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Abstract: The next Landsat satellite, which is scheduled for launch in early 2013, will 
carry two instruments: the Operational Land Imager (OLI) and the Thermal Infrared Sensor 
(TIRS). Significant design changes over previous Landsat instruments have been made to 
these sensors to potentially enhance the quality of Landsat image data. TIRS, which is the 
focus of this study, is a dual-band instrument that uses a push-broom style architecture to 
collect data. To help understand the impact of design trades during instrument build, an 
effort was initiated to model TIRS imagery. The Digital Imaging and Remote Sensing 
Image Generation (DIRSIG) tool was used to produce synthetic “on-orbit” TIRS data with 
detailed radiometric, geometric, and digital image characteristics. This work presents 
several studies that used DIRSIG simulated TIRS data to test the impact of engineering 
performance data on image quality in an effort to determine if the image data meet 
specifications or, in the event that they do not, to determine if the resulting image data are 
still acceptable. 
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1. Introduction 

The next Landsat satellite, referred to as LDCM or Landsat 8, is scheduled for launch in early 2013 
and will carry two instruments. The Operational Land Imager (OLI) is a push-broom multispectral 
sensor designed to continue or expand on the Landsat Enhanced Thematic Mapper Plus (ETM+) 
reflective imaging capabilities [1]. The Thermal Infrared Sensor (TIRS) is a two band push-broom 
thermal infrared sensor designed to continue or enhance the Landsat ETM+ thermal imaging 
capabilities [2] . The TIRS instrument, which is the focus of this study, represents a significant departure 
from previous Landsat thermal sensors. First it is a separate instrument whose data are to be combined 
with the OLI data to form a registered image data set. In addition, it is a push-broom design using three 
two-dimensional array Quantum Well Infrared Photodetector (QWIP) detectors to span the cross-track 
direction [3]. Filters are used to allow acquisition of two spectral bands (see Figure 1). In addition to 
these fundamental changes, TIRS uses refractive optics instead of ETM+’s reflective optics and a 
single full aperture radiometric calibrator and a deep space view which can be periodically introduced 
instead of ETM+’s dual source internal calibrator which is monitored at the beginning and end of 
every line of data. 

These differences from the ETM+ design will potentially result in a number of changes in the 
character of the Landsat 8 image data. To better understand the impact of design trades during 
instrument build and test and to evaluate image processing algorithms and image quality issues in 
flight, an effort was initiated to model TIRS images. The goal of this modeling effort is to produce 
synthetic data streams that have the detailed radiometric, geometric, and digital image characteristics 
that TIRS data will have. As described in Section 2, these simulated data can then be used to test the 
impact of engineering performance data on image quality, to determine if the image data meet 
specifications or, if they do not, to determine if the resulting image data are still acceptable. Similar 
studies will be conducted to support the NASA/USGS image assessment teams as they identify and 
attempt to compensate for anomalies and changes in instrument performance during operation on orbit. 
The Digital Imaging and Remote Sensing Image Generation (DIRSIG) modeling tool is being used for 
these simulations. The DIRSIG tool has been extensively developed to simulate the spectral radiance 
images produced by sensors that observe the reflective and emitted energy from the Earth’s 
surface [4,5]. DIRSIG incorporates solar irradiance, sky light illumination, atmospheric propagation, 
thermal models, self emission, reflection of thermal downwelled radiance and scattered and emitted 
path radiance. To support the Landsat sensor modeling effort described here, a number of 
improvements to the DIRSIG sensor modeling tools were developed to produce high fidelity 
simulation of the Landsat 8 instruments. 
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Figure 1. Illustration of the Thermal Infrared Sensor (TIRS) focal plane layout. Three 
Quantum Well Infrared Photodetector (QWIP) arrays containing 512 by 640 detectors make 
up the focal plane. Spectral fdters and masks are placed over specific areas of each QWIP to 
produce the two TIRS spectral channels and the blind band. Data from the filtered regions on 
the three QWIP arrays are combined to produce an effective across-track linear imaging 
array of 1,850 detectors per band by discarding approximately 7 columns on either end of 
the line and allowing for approximately 28 columns of overlap between adjacent arrays. 
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2. Results and Discussion 

2.1. Orbit, Earth Geometry and External Sensor Models 

In order to effectively model the Landsat image acquisition geometry, the DIRSIG model was 
modified to incorporate dynamic motion of the spacecraft as described by NORAD Two Line Element 
(TLE) orbital descriptors. Using the simplified general perturbation version 4 (SGP4) code [6] the 
satellite location and velocity vectors at each sample time desired (e.g., for each clock cycle of the 
detector read electronics) are produced from the TLE data. In order to take advantage of this orbital 
data, the DIRSIG scene geometry was upgraded to incorporate descriptions of the Earth that include 
the WGS 84 Geoid geometry with digital elevation maps (DEMs) superimposed, see Figure 2. 

Note that because the various bands and arrays “look” forward or aft at different view angles, the 
parallax shifts are different for targets at different target-sensor slant paths (elevations). This means 
that all the appropriate acquisition geometry has to be properly modeled in DIRSIG to introduce the 
actual amount of band-to-band misregistration in the “raw” data stream sensed by the simulated 
system. These band-to-band registration issues are further complicated for Landsat 8 because the OLI 
and TIRS sensors, while on the same platform, have separate lines of sight and the line of sight 
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variation induced by deck warping and jitter will differ for the two instruments. In order to account for 
these, the DIRSIG models account for offsets in the mounting locations and independent external 
geometry descriptors and jitter models for the two instruments [7]. 

Figure 2. Illustration of how a digital elevation map (DEM) is superimposed on the Geoid 
to form a 3D surface that can be facetized to form a “scene” in Digital Imaging and 
Remote Sensing Image Generation (DIRSIG). 
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2.2. Internal Geometry Models 

The internal geometry models for a TIRS type sensor are complicated from “text book” push-broom 
geometry by a number of factors. First in order to align the 3 QWIP arrays and account for read out 
electronics, the arrays must be offset from each other in the “in-track” direction (see Figure 1). In 
addition, the arrays are not perfectly aligned with each other or with the “cross-track” direction. Finally 
optical distortion causes the projection of an image to shift differently at different locations on the 
focal plane (e.g., barrel or pin cushion distortion). To account for these distortions, DIRSIG was 
modified to enable the angular location from the optical axis of the center of each detector element to 
be input in table form for each spectral band (see Figure 3). 

For devices such as TIRS, where different rows or even detectors can be selected for imaging and 
downlink, a selectable look-up table of detector locations can be implemented [7]. For the TIRS study, 
the detector location information was acquired using geometric camera calibration data acquired 
during the instrument environmental testing. This location information can also be used to control 
detector sampling times and read out to generate data acquisition and readout data that mimic actual 
data streams. 
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Figure 3. Illustration of angle-angle lines of sight relative to the optical axis for each 
detector element (left). The complexity of the focal plane and how this is converted to an 
angle-angle look-up table (in this case for OLI) are shown at the right. 
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2. 3. Simulated Scene 

In order to test the enhanced sensor, orbit, and Earth geometry models a simulated scene was 
constructed representing a significant fraction of a Landsat image. The scene was designed to simulate 
the complete Landsat 8 image product (i.e., OLI and TIRS data). Therefore, the spatial fidelity had to 
span from the OLI 15 m panchromatic and 30 m multispectral to the 100 m TIRS bands (which are 
resampled and registered to the OLI 30 m pixels in final products). In addition, the spectral data 
needed to cover the visible through the long wave infrared range of the two instruments was 
implemented into the simulated scene. This was accomplished by projecting high resolution (4 m) 
satellite multispectral data onto the facetized DEM to generate multispectral texture maps. This was 
supplemented in the LWIR with ASTER derived emissivity texture maps [8]. These data were also 
used to generate simple land cover maps (9 classes). Registered AVIRIS data over a large portion of 
the site were inverted to reflectance and the land cover maps used to generate spectral 
reflectance/emissivity libraries for each land cover class. DIRSIG uses the combination of land cover 
type, local texture and a spectral reflectance/emissivity library to assign a spectral reflectance to each 
sub-pixel sample point [9]. In addition, each land cover class is assigned thermodynamic properties 
(e.g., specific heat, conductivity, etc.) needed to drive the DIRSIG thermal model. Note that the terms 
the model is most sensitive to (i.e., solar absortivity, emissivity, slope, and azimuth) are computed on a 
sub-pixel, per sample basis using spectral library data and the DEM [10]. Figure 4 is an example data 
set showing a simulated TIRS band of a small subsection of the image where two arrays meet. Thus 
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one array is imaging slightly ahead of the satellite ground track and one is imaging slightly behind. To 
simulate this scene a TLE orbital description for Landsat 7 was used to “fly” the satellite. The nominal 
clock rates and Earth-centered pointing planned for OLI were used to sample and orient the sensor. 
Also shown in Figure 4 are an actual Landsat 7 thermal image (top right) and a TIRS band 1 image after 
alignment (bottom right) illustrating the radiometric similarities. Note that no significant effort was made 
to match the modeled actual meteorological or phenological conditions to improve the match. 

Figure 4. Example data set (left) showing a simulated TIRS band of a small subsection of 
the Lake Tahoe simulated landscape where the two arrays meet. One array is imaging 
slightly ahead of the satellite ground track and one is imaging slightly behind. Also, an 
actual Landsat 7 thermal image (top right) and a simulated TIRS band 1 image after 
alignment but before geo-rectification (bottom right) are shown to illustrate the 
radiometric similarities. 



Elaving upgraded the DIRSIG model, built a Landsat specific sensor model and a scene with 
Landsat TIRS relevant features, the TIRS instrument team turned to simulation and modeling to help 
understand and address a number of critical issues that arose during instrument build and test. 

2. 4. Simulation of the Potential Impact of TIRS Edge Response Waiver 

The TIRS spatial resolution is largely characterized by the shape of the edge spread function (i.e., 
how the sensor responds to an edge transition from low radiance to high). During the ground testing of 
the TIRS instrument an edge is introduced using an edge with a hot background behind it at the focal 
plane of a collimator. The collimator projects the radiance field from the edge into the TIRS entrance 
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aperture to simulate what an edge on the Earth (i.e., very far away) would look like. The TIRS sensor 
forms an image of the edge from which the edge spread function (ESF) can be calculated (see Figure 5). 

Figure 5. Illustration of an edge spread function (ESF) calculated with the TIRS instmment 
when observing an edge transition between low and high radiance targets. The blue line 
illustrates the perpendicular to the edge that was used to calculate the edge spread function. 
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During testing it was observed that the TIRS instrument did not meet the specified edge slope which 
was designed to control its resolution. To test the impact of this discrepancy, two sets of DIRSIG 
images were produced. One set of images was produced with the specified edge slope (edge 
spread function) and the other with the observed edge spread function. These scenes were simulated 
by generating over-sampled images (5x5 samples per pixel) in DIRSIG and then convolving the 
over-sampled image with the point spread function (PSF) associated with each ESF. Note, the one 
dimensional PSF is the first derivative of the ESF [4]. The convolved image is then down-sampled to 
the size of the TIRS image. To test the impact of the ESF variation, a scene with large test targets 
arrayed in Fake Tahoe was produced (see Figure 6). The targets had temperature differences with 
respect to the lake of -10 K to 60 K in steps of 10 K. Temperature difference image maps produced 
from images with the specified and observed ESFs are also shown in Figure 6. These data show that 
significant thermal change induced by the potential blurring associated with the discrepancy from the 
specified ESF only occurs at extremely high contrast (unrealistically high for most targets). These 
simulations were generated through four different MODTRAN standard atmospheres. The mid-latitude 
winter atmosphere produced the greatest apparent temperature difference between the specified and 
observed ESF images. The minimum, maximum, mean, and standard deviation of the mid-latitude 
winter case was 0.00 K, 1.04 K, 0.15 K, and 0.15 K, respectively. 

At the time this study was conducted, the discrepancy between the specified and observed ESF was 
believed to be due to a slight blurring of the input edge introduced by the ground support equipment 
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(GSE). The TIRS program granted a waiver on TIRS meeting the edge response based on the 
assessment that the issue was likely due to GSE issues not instrument issues and due to the very 
limited impact, if it was an instrument issue, as demonstrated by the simulated data (see Figure 6). 

Figure 6. Apparent temperature difference map (in units of Kelvin) between the specified 
ESF image and the observed ESF image for the 10.8 pm band (center) and the 12.0 pm 
band (right) through a MODTRAN mid-latitude summer atmosphere. The test targets 
located in the lake had the thermal and material properties illustrated (left). 



2.5. Impact of TIRS Cryocooler on Image Quality 

During the design and early testing of the TIRS cryocooler there was concern that the exported 
vibration from the cryocooler would induce jitter into the TIRS or OLI instmment lines of sight to an 
extent where unacceptable image blur might result. To assist in evaluating these impacts, DIRSIG was 
modified to accept both random and correlated jitter spectra as inputs to its pointing model. The jitter 
spectra are converted in the model to instantaneous samples of the deviation of the optical axis in the 
in-track and across-track angular directions. The deviations in the optical axis are then used to adjust 
the optical axis of the simulated sensor each time an image is acquired. However, because the optical 
axis moves (due to jitter and sensor motion) during the time the photons are being collected during a 
sample, blurring occurs due to the within-cycle motion as well as geometric distortion due to 
movement between clock cycles. To account for this, DIRSIG was set to over-sample each pixel 
spatially and temporally (11 times in x and y and 1 1 times temporally). The 1 1 temporally over-sampled 
images are then convolved and resampled spatially and temporally to provide the final simulated TIRS 
image. Figure 7 shows a simulated OFI image produced during algorithm development and testing. 
The induced jitter for this test had a single low frequency high amplitude mode in the across-track 
direction resulting in the wavy appearance of the perfectly straight bridge. Note that for these 
simulations, bridge targets were added to Fake Tahoe in roughly the along and cross-track directions to 
simulate the targets used operationally to evaluate Fandsat spatial resolution [11]. Figure 7 also shows 
input jitter spectra from a more realistic case (provided by NASA) and spectra computed from the 
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DIRSIG generated angular data to verify that pointing data were being correctly simulated. In these 
simulations two sources of jitter were simulated, the background spacecraft jitter plus the incremental 
jitter induced by the TIRS cryocooler [12], 


Figure 7. Left column shows simulated OLI imagery produced during algorithm 
development and testing. A high magnitude jitter was applied in the cross-track direction 
for visual comparison to the “no jitter” case. The right column shows a validation of the 
DIRSIG jitter model by comparing the input spectra to the spectra derived from the 
DIRSIG generated angular data (Note the data sets sit on top of each other). 



Jitter Simulation 




Figure 8 shows some results from the jitter simulations. We utilized a common image based MTF 
measurement technique [13] to quantitatively assess the impact of the modeled jitter at various levels. 
The left hand side plot of Figure 8 shows the absolute MTF for the various jitter scenarios modeled 
while the right hand side plot shows the MTF impact of each jitter scenario relative to the no jitter 
case. We found the MTF impact, as measured from the simulation image products, to closely follow a 
Gaussian shape commensurate with the root -mean-square level of jitter [14] for each scenario. 

Note the results are shown for the effects of the TIRS cryocooler on OLI since TIRS, with its much 
larger pixels (100 m vs. 30 m), was not significantly impacted by even the high jitter levels. The 
images with various levels of jitter were provided to the NASA and USGS image assessment teams for 
evaluation. In the end, to avoid these jitter concerns, further engineering improvements were made to 
dampen the cryocooler induced vibrations and no significant impacts of jitter on image quality are 
expected. However, the jitter modeling and all the other DIRSIG improvements are available to 
support the image assessment teams to help understand and hopefully mitigate any issues that arise in 
the imagery after launch. 
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Figure 8. MTF calculated from “bridge” edges in the OLI simulated scenes for the ‘no 
jitter’ and the ‘TIRS jitter x 5’ case (left). The jitter impact is more clearly seen in the 
relative ( i.e ., ratio to no jitter) plots (right). 
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2. 6. Impact of Relative Spectral Response (RSR) Variation on TIRS Streaking and Banding 


To achieve the relatively wide angle (15°) coverage of the TIRS push-broom design, three linear 
arrays are employed (see Figure 1). Each array has a slightly different relative spectral response (RSR) 
resulting from slight differences in the manufacturing of the detectors and spectral filters. These 
differences can result in array to array banding effects. In addition, each detector element within 
an array can have slight RSR differences resulting in detector-to-detector variations or streaking. 
Flat-fielding procedures are designed to minimize banding and streaking by forcing the response of all 
detectors to the same two levels for a hot and cold blackbody target {i.e., detector by detector bias and 
gain adjustment). This is accomplished on TIRS with a full aperture blackbody that can be set at 
different levels and by periodic deep space looks. Regrettably, these procedures are only completely 
effective if the RSRs are truly identical or the targets all have the same spectral shape as the 
blackbodies. Since neither of these cases is true some banding and streaking will occur. To understand 
the maximum impact of banding and streaking expected from TIRS, DIRSIG was used to simulate 
images of a range of targets observed through a variety of atmospheres (note the atmosphere 
introduces a great deal of spectral shape, often more than material differences, in the LWIR). Recent 
improvements to DIRSIG allow the user to assign individual RSRs to each detector element as well as 
detector specific gains and bias values such that the final output can be expressed as: 


DC„ = 0 


g G 

6 V J 


)L, ii RSR iJ cn 

\RSR.dA 


+ Bj+b..+. 


( 1 ) 


where DCy is the digital count from the / th detector in the / h array [counts]; 
Q indicates the quantization process (12 bits for TIRS) [counts/volt]; 
Gj is average gain of the j th array [volts/(w-cm 2 -sr '-pm ')]; 
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gij is the relative gain of the i th detector compared to the array average for array j [unitless]; 

Luj is the spectral radiance reaching the i th detector in the j th array computed by DIRSIG 
[w-cm 2 -sr '-pm J ]; 

RSRij is the relative spectral response of the ij th detector; 

Bj is the average bias of the /*' array [volts]; 

by is the deviation of the bias of the i th detector in an array j from the array average [volts]; 

X is the wavelength [pm] and 

n,j is the detector specific noise [volts]. 

During the development and test of the TIRS instrument, the RSR values for individual detector 
elements were determined using a spectrometer and a collimator designed to fill the entrance aperture. 
These RSR values were provided by NASA Goddard based on early testing and used in selecting 
arrays and evaluating expected image quality relative to banding and streaking effects. The test scene 
shown in Figure 9 includes a range of targets with varying emissivities set at a wide range of 
temperatures (see Figure 6). 

Figure 9. Percent differences between the two mean class shapes in the 10.8 pm channel 
(top row) and 12.0 pm channel (bottom row). From left to right are tropical, mid-latitude 
summer, mid-latitude winter, and sub-arctic summer atmospheres. Maximum scene 
differences between the two band shapes are approximately 0.1% and a 0.2% for the 10.8 pm 
and 12.0 pm channel, respectively. 



The band shapes of all detectors within a spectral band were grouped into classes. The mean band 
shape of the two most different classes were provided by NASA Goddard to apply to the synthetic 
scene. To determine the effect of the two different band shapes within a TIRS channel, each class 
mean band shape was applied separately to every detector on the DIRSIG scene. In addition, each band 
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shape was run with four MODTRAN standard atmospheres assigned to the DIRSIG scene. Every 
combination of class mean/band shape (two shapes for each TIRS channel) and MODTRAN scene 
atmosphere (tropical, mid-latitude summer, mid-latitude winter, and sub-arctic summer) yielded 16 
DIRSIG scene images. These radiance images were then expressed as apparent temperatures. The 
percent difference between the two resulting temperature images for a given TIRS channel and for a 
particular atmosphere were calculated (see Figure 9). These differences represent the difference that 
would occur at the boundary between two arrays. In general, the differences between the two band 
shape classes can be expected to produce approximately a 0.1% and a 0.2% temperature difference 
among various materials for a range of atmospheres for the 10.8 pm and 12.0 pm channels, 
respectively [15], 

2. 7 . Potential Use of Side Slither Maneuvers for Flat Field Calibration 


As indicated in Section 2.6, the planned method for flat field calibration (calculation of detector 
gain and biases to minimize banding and streaking) is to use the on-board full aperture blackbody. As a 
risk mitigation effort, an initial study was conducted to evaluate the potential to use data collected 
during a side slither maneuver to supplement, or replace if necessary, the on-board calibrator. In this 
maneuver, the satellite is yawed 90° such that to first order all the detectors in an array image over the 
same line of points on the Earth [16]. Thus, over time each detector sees the same target. In practice 
this maneuver is done over relatively uniform targets and many samples (e.g., 1,000) in the in-track 
line are averaged. By averaging the same 1,000 pixel region on the Earth as seen sequentially by each 
detector, we generate signals (digital counts) that “should” be the same for each detector. First, the 
dark (low radiance) values are bias adjusted to a common value based on a deep space look. Then the 
relative gains can be corrected to force the signals to a common value according to 


Su = 


DC, 

DC: 


( 2 ) 


where DCy is the average digital count for the side slither samples from the / th detector in the / h array 
and DC j is the average of all the DCy values in the / h array. 


Using the relative gains calculated according to Equation (2), streaking effects should be removed. If 
the arrays look at features on the ground that have the same radiance on average then an array-to-array 
relative gain correction can also be calculated in a similar fashion. Note, that this is complicated by the 
fact that in side slither mode the before and aft looking arrays are now looking slightly east or west of 
the nominal ground track at different lines of targets on the ground (see Figure 10). Thus, this requires 
imaging of very homogeneous scenes. Another alternative is to perform array-to-array relative gain 
corrections by taking advantage of the roughly 28 pixel overlap in the ground track between the edges 
of adjacent arrays in the normal push-broom mode (see Figure 1). 

For this study, variation in the individual detector electronic gain values was simulated (deep space 
is used to get a background measurement to subtract off the instrument self-emitted signal). Side 
slither data were then simulated using DIRSIG to “fly” the TIRS sensor over a scene with actual 
Fandsat thermal data “glued” to the Earth. This was done to evaluate the spatial uniformity of the 
radiance from the Earth in terms of its suitability for side slither based flat fielding. 
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Figure 10. Illustration of the ground track of two TIRS arrays when imaging in side slither 
mode. The dark lines represent the ground tracks for a fore and aft looking array 
superimposed on a Landsat 5 image. 
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For this simulation, only 300 detectors on one of the TIRS arrays were simulated. Each detector was 
assigned a unique RSR, gain, and bias derived from actual pre-flight measurements. A simulated 
radiometric drift was applied by randomly varying the gain and bias of each detector. The side slither 
data was then utilized to develop a relative correction for the detectors to reduce the striping artifact. 
Figure 1 1 demonstrates an original simulated scene without radiometric drift along with striping that 
occurs due to induced random per-detector drift. The relative correction based on the side-slither data 
is then applied to significantly reduce the striping [17]. 


Figure 11. DIRSIG radiance scene of Algeria (left). Radiance image calibrated using pre- 
flight radiometric coefficients (center). Radiance image calibrated using pre-flight 
coefficients with relative correction derived from side-slither data (right). 
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This simulation was performed as a proof of concept for only a subset of the TIRS focal plane. 
Atmospheric effects were also neglected in this study. Future work will expand this simulation to 
include the three staggered focal plane arrays and will also include atmospheric and BRDF effects. 

3. Conclusions 

The studies presented here have demonstrated how a synthetic image generation tool has been 
modified to provide detailed simulation of the performance of the TIRS sensor. The several examples 
cited show how such a detailed simulation capability can be and was used by an instrument 
development team to support design trade-off and engineering trade studies. In these studies the 
simulations showed that the potential degradation in the edge slope from the specified value could 
induce worst case (for a 60° K edge) errors of 1.05 K (with 0.15 K the mean expected value). The 
simulations of TIRS induced jitter on OLI showed that the MTF could be reduced by more than 2% 
(worst case) and contributed to the decision to improve the cryocooler dampening. Note, tests showed 
the DIRSIG jitter model implementation could reproduce the predicted jitter to within numerical 
accuracy. The TIRS array to array RSR differences were shown to induce acceptable apparent 
temperature differences at array boundaries of 0.2% or less for the worst case atmospheric conditions 
and worst spectral band. 

Ongoing work is targeted at using modeling to support the continued development of in-scene 
calibration techniques. Another problem faced by the Landsat team is the cross-registration of OLI and 
TIRS datasets. To support this effort, DIRSIG simulations of potential target scenes are being 
developed and simulated imagery from both sensors will be generated with known pointing and jitter 
errors to determine what targets have sufficient correlation to enable assessment of the pointing errors. 
Finally, we expect to use the DIRSIG tools to support the NASA and USGS image assessment teams 
to simulate and attempt to understand instrument anomalies when the instruments are in orbit. 
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